Systems and methods for optical performance captured animated figure with real-time reactive projected media

ABSTRACT

A reactive media system includes a motion control system having an animated figure with a body and actuators configured to adjust a figure portion of the body in response to interactive data received from one or more interactive data sources. The reactive media system includes a media control system having a tracking camera configured to generate signals indicative of a current position and orientation of the figure portion based on a set of trackers coupled to the figure portion. The media control system includes a media controller configured to receive the signals, determine the current position and orientation based on the signals, and generate data indicative of images to be projected onto an external surface of the figure portion having the current position and orientation. The media control system also includes a projector configured to receive the data from the media controller and project the images onto the external surface.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority to and the benefit of U.S. ProvisionalApplication No. 62/956,468, entitled “SYSTEMS AND METHODS FOR OPTICALPERFORMANCE CAPTURED ANIMATED FIGURE WITH REAL-TIME REACTIVE PROJECTEDMEDIA,” filed Jan. 2, 2020, which is hereby incorporated by reference inits entirety for all purposes.

BACKGROUND

This section is intended to introduce the reader to various aspects ofart that may be related to various aspects of the present techniques,which are described and/or claimed below. This discussion is believed tobe helpful in providing the reader with background information tofacilitate a better understanding of the various aspects of the presentdisclosure. Accordingly, it should be understood that these statementsare to be read in this light, and not as admissions of prior art.

Amusement parks and other entertainment venues contain, among many otherattractions, animated figures to entertain park guests that are queuedfor or within a ride experience. Certain animated figures may be broughtto life by projection mapping, which traditionally directs predeterminedappearances onto the animated figures. For example, a particularanimated figure may be visually supplemented with a canned or fixed setof images, which may align with preprogrammed movements of the animatedfigure. While such techniques may provide more entertainment than flatdisplay surfaces, it is presently recognized that advancements may bemade to further immerse the guests within a particular attraction, ride,or interactive experience. For example, certain animated figures have aninternally-positioned projector that generates an unrealisticbacklighting or glow via internal or rear projection through asemi-transparent projection surface of the animated figure. As such, itis now recognized that it is desirable to make the animated figuresappear more lifelike, as well as to provide the animated figures withthe ability to contextually blend with their environment in a realistic,convincing manner.

SUMMARY

Certain embodiments commensurate in scope with the originally claimedsubject matter are summarized below. These embodiments are not intendedto limit the scope of the disclosure, but rather these embodiments areintended only to provide a brief summary of certain disclosedembodiments. Indeed, the present disclosure may encompass a variety offorms that may be similar to or different from the embodiments set forthbelow.

In an embodiment, a reactive media system of an amusement attractionincludes a motion control system that includes an animated figure havinga body and a set of actuators configured to adjust a figure portion ofthe body in response to interactive data received from one or moreinteractive data sources. The motion control system also includes a setof trackers coupled to the figure portion of the body. The reactivemedia system includes a media control system that includes a trackingcamera configured to generate signals indicative of a current positionand a current orientation of the figure portion based on the set oftrackers. The media control system includes a media controller coupledto the tracking camera and configured to receive the signals indicativeof the current position and the current orientation. The media controlsystem is also configured to determine the current position and thecurrent orientation based on the signals and generate data indicative ofimages to be projected onto an external surface of the figure portionhaving the current position and the current orientation. The mediacontrol system also includes a projector communicatively coupled to themedia controller. The projector is configured to receive the dataindicative of the images from the media controller and project theimages onto the external surface of the figure portion having thecurrent position and the current orientation.

In an embodiment, a method of operating a reactive media system of anamusement attraction includes receiving, via a figure controller of ananimated figure, interactive data from one or more interactive datasources of the amusement attraction and generating, via the figurecontroller, an interactive response of the animated figure based on theinteractive data. The method includes instructing, via the figurecontroller, actuators disposed within the animated figure to perform theinteractive response by moving at least a portion of a body of theanimated figure. The method also includes receiving, via a mediacontroller, sensor feedback indicative of a current position andorientation of the body of the animated figure from a tracking cameracoupled to the media controller. The tracking camera is configured tosense the current position and orientation based on at least one trackerconcealed on the body of the animated figure. Additionally, the methodincludes generating, via the media controller, a set of images to beprojected onto an external surface of the body of the animated figurehaving the current position and orientation and instructing, via themedia controller, a projector to contour map the set of images onto theexternal surface of the body having the current position andorientation.

In an embodiment, a reactive media system of an amusement attractionincludes one or more interactive data sources configured to generateinteractive data that is variable over time and a motion control systemthat includes an animated figure disposed within the amusementattraction. The animated figure includes a figure portion that includesa moveable joint. The motion control system also includes a set ofactuators disposed within the figure portion and configured to actuatethe moveable joint. Additionally, the motion control system includes afigure controller communicatively coupled to the set of actuators andthe one or more interactive data sources. The figure controller isconfigured to, based on the interactive data from the one or moreinteractive data sources, determine an interactive response of theanimated figure corresponding to a current state of the animated figure.The interactive response includes actuating the moveable joint. Thefigure controller is also configured to instruct the set of actuators toperform the interactive response. Moreover, the reactive media systemincludes a set of trackers coupled to the figure portion of the animatedfigure. The set of trackers enables a media control system of thereactive media system to project images onto an external surface of thefigure portion of the animated figure in synchronization with theinteractive response of the motion control system.

BRIEF DESCRIPTION OF DRAWINGS

These and other features, aspects, and advantages of the presentdisclosure will become better understood when the following detaileddescription is read with reference to the accompanying drawings in whichlike characters represent like parts throughout the drawings, wherein:

FIG. 1 is a schematic diagram illustrating an embodiment of an amusementattraction or experience having a reactive media system to controlprojection-mapped images displayed on an animated figure, in accordancewith embodiments of the present disclosure;

FIG. 2 is a schematic diagram illustrating an embodiment of the reactivemedia system including guest sensors that enable the animated figure toreact to guest input, in accordance with embodiments of the presentdisclosure;

FIG. 3 is a block diagram of an embodiment of the reactive media systemof FIG. 1 or 2 that enables the animated figure to react to interactivedata sources, such as based on a media control system that detectsmovements and positions of the animated figure, in accordance withembodiments of the present disclosure;

FIG. 4 is a cross-sectional schematic diagram of an embodiment of a headportion of the animated figure of FIG. 1 having an articulating jaw andrear-mounted trackable trackers, in accordance with embodiments of thepresent disclosure;

FIG. 5 is a cross-sectional schematic diagram of an embodiment of thehead portion of the animated figure of FIG. 1 having front-mountedtrackable trackers, in accordance with embodiments of the presentdisclosure;

FIG. 6 is a front perspective view of an embodiment of facial featuresthat are projection mapped onto the head portion of the animated figureof FIG. 1 , in accordance with embodiments of the present disclosure;

FIG. 7 is a front perspective view of another embodiment of facialfeatures that are projection mapped onto the head portion of theanimated figure of FIG. 1 , in accordance with embodiments of thepresent disclosure;

FIG. 8 is a flow diagram of an embodiment of a process by which a motioncontrol system may control the animated figure of FIG. 1 to respond tothe interactive data sources of FIG. 3 , in accordance with embodimentsof the present disclosure; and

FIG. 9 is a flow diagram of an embodiment of a process for the mediacontrol system to dynamically project images onto the animated figure ofFIG. 1 , which may be responding to the interactive data sources at anygiven time, in accordance with embodiments of the present disclosure.

DETAILED DESCRIPTION

One or more specific embodiments of the present disclosure will bedescribed below. In an effort to provide a concise description of theseembodiments, all features of an actual implementation may not bedescribed in the specification. It should be appreciated that in thedevelopment of any such actual implementation, as in any engineering ordesign project, numerous implementation-specific decisions must be madeto achieve the developers' specific goals, such as compliance withsystem-related and business-related constraints, which may vary from oneimplementation to another. Moreover, it should be appreciated that sucha development effort might be complex and time consuming, but wouldnevertheless be a routine undertaking of design, fabrication, andmanufacture for those of ordinary skill having the benefit of thisdisclosure.

When introducing elements of various embodiments of the presentdisclosure, the articles “a,” “an,” and “the” are intended to mean thatthere are one or more of the elements. The terms “comprising,”“including,” and “having” are intended to be inclusive and mean thatthere may be additional elements other than the listed elements.Additionally, it should be understood that references to “oneembodiment” or “an embodiment” of the present disclosure are notintended to be interpreted as excluding the existence of additionalembodiments that also incorporate the recited features.

Present embodiments are directed to a reactive media system for anamusement attraction, such as an attraction in which a projector of amedia control system directs images onto an external surface of ananimated figure. Notably, the animated figure responds to any suitablenumber of interactive data sources or streams, which may include acurrent state of the animated figure, control instructions from anartificial intelligence (AI) engine, actions or passive qualities ofguests, actions of backstage or on-stage performers, and so forth. Assuch, the reactive media system provides a dynamic and immersiveexperience to guests, in which the animated figure resembles a realperson or character more closely than achievable before the presenttechniques. In particular, by projection mapping onto the externalsurface of the animated figure, the animated figure may appear morelifelike than certain animated figure systems that internally projectimages through a semi-transparent surface of an animated figure, therebygenerating an unnatural or ethereal glowing appearance. As discussedherein, the reactive media system leverages external tracking (e.g., viaoptical performance capture or optical motion capture) of the animatedfigure to dynamically generate and provide images onto the externalsurface of the animated figure, thereby reducing or eliminating anyunnatural backlighting. Indeed, because certain animated figures mayinclude an internal projector within a body of the animated figure, theinternal projector does not move relative to the animated figure andthus figure or movement tracking is not required. As an additionalbenefit, positioning the projector external to the animated figureenables space within the animated figure to house more complex ornumerous actuators, which may otherwise block or physically interferewith traditional internal projection mapping techniques.

In more detail, to enhance the authenticity of the animated figure, theanimated figure may be fitted with trackers that enable tracking camerasof a media control system to discern movements, positions, andorientations of the animated figure in real-time via optical performancecapture or optical motion capture. Thus, because the media controlsystem may operate independently of the animated figure (e.g., by notrelying on position, velocity, and/or acceleration information regardingactuators of the animated figure), the media control system maydynamically generate and fit projected images onto the interactiveanimated figure at a realistic framerate that emulates live characters,such as by presenting textures, colors, and/or movements that appear tobe indistinguishable from the animated figure. As will be understood,the media control system of certain embodiments may generate and updatea skeletal model of the animated figure based on feedback from thetracking cameras. The skeletal model generally represents the moveableportions of the animated figure, such as actuatable joints thereof, andis dynamically updated to represent a current three-dimensional position(e.g., including x, y, and z coordinates), orientation, and scale of theanimated figure or portions thereof (e.g., a pose of the animatedfigure). The media control system therefore utilizes the skeletal modelto generate the images for projection that precisely suit the currentposition and orientation of the reactive and/or interactive animatedfigure. The reactive media system therefore provides the motion controlsystem having the animated figure that is responding to the interactivedata, as well as the media control system that is reactive to themechanical performance of the animated figure. As discussed below, thesetwo closed control loops therefore provide improved system performancebased on the optical motion capture of the animated figure to deliver anengaging character presentation to guests, regardless of the mechanicalpositioning of the animated figure.

As illustrated in FIG. 1 , a reactive media system 8 of an amusementattraction 10 includes an animated FIG. 12 that receives images 14(e.g., projected content) from a projector 16 (e.g., external projector,optical projector with lens) of a media control system 20. In thepresent embodiment, the amusement attraction 10 is a show set having astage ceiling 22, a stage floor 24, and scenery objects 26 disposedbetween the stage ceiling 22 and the stage floor 24. The show set mayalso include any suitable stage lighting devices 30, such as theillustrated lighting instruments or devices. From a guest area 32 of theamusement attraction 10, multiple guests 34 may view and/or interactwith the animated FIG. 12 , in accordance with the present techniques.Although illustrated as within a stage-type environment, it should beunderstood that the reactive media system 8 may be utilized to entertainguests 34 in any suitable entertainment environment, such as a darkride, an outdoor arena, an environment adjacent to a ride path of a ridevehicle carrying the guests 34, and so forth.

Notably, the projector 16 is external to the animated FIG. 12 , therebyenabling an enclosed volume within the animated FIG. 12 to be utilizedto house components other than the projector 16, such as certainactuation systems discussed below. In the illustrated embodiment, theprojector 16 is disposed in front of the animated FIG. 12 and obstructedfrom sight of the guests 34 by an overhang 36 of the stage ceiling 22.It should be recognized that the overhang 36 may alternatively be acurtain or that the amusement attraction 10 may take any other suitableform for enabling the guests 34 to view the animated FIG. 12 . In otherembodiments, the projector 16 may be positioned behind the guests 34. Inany case, the projector 16 directs the images 14 onto an externalsurface 40 of a body 42 of the animated FIG. 12 , which corresponds to ahead portion 44 of the animated FIG. 12 , in the present embodiment. Themedia control system 20 may therefore deliver realistic and engagingtextures to the head portion 44 from a concealed location, therebyproviding an immersive and interactive experience to the guests 34.Indeed, as previously mentioned, the media control system 20 of thereactive media system 8 enables the animated FIG. 12 to appear morelifelike than an animated figure with internal projection, because themedia control system 20 does not produce an internal, unnatural glow ofthe animated FIG. 12 that an internally-positioned projector of certainanimated figures may generate.

As recognized herein, the animated FIG. 12 is part of a motion controlsystem 50 (e.g., figure control system, prop control system) thatoperates independently of the media control system 20, in certainembodiments. For example, the motion control system 50 may receiveinteractive data from any suitable reactive and/or interactive datasources, discussed in more detail below. Thus, the animated FIG. 12 mayleverage the interactive data to dynamically update or modify itsinteractions with the amusement attraction 10 and/or the guests 34therein. It should be understood that the motion control system 50 mayinstruct actuators to adjust the position of any suitable components ofthe amusement attraction 10 that may be viewable to the guests 34.Additionally, as discussed in more detail with reference to FIGS. 2 and3 below, based on suitable interactive data, the motion control system50 may generate an interactive and/or reactive response and instructactuators of the animated FIG. 12 and/or the motion control system 50 toperform the interactive and/or reactive response in real-time. Asdescribed below, the reactive media system 8 may also coordinateoperation of the stage lighting devices 30 and/or any interactive oractuatable components of the scenery objects 26 to provide a response tothe interactive data sources that coordinates with the response of theanimated FIG. 12 . Moreover, the motion control system 50 may control anactuatable motion device 66 (e.g., actuatable motion base) that isphysically coupled to the animated FIG. 12 . The actuatable motiondevice 66 may be any suitable motion-generating assembly that may move(e.g., translate, rotate) the animated FIG. 12 laterally,longitudinally, and/or vertically. However, it should be understoodthat, in other embodiments, the actuatable motion device 66 may be orinclude a suspension system and/or flying system that is coupled to theanimated FIG. 12 from above the stage floor 24. Therefore, thesuspension system and/or flying system of the actuatable motion device66 may include any suitable actuators designed to move the animated FIG.12 laterally, longitudinally, and/or vertically.

Notably, the motion control system 50 includes trackers 60 (e.g.,trackable markers) that are positioned on a back surface 62 of theanimated FIG. 12 , in the present embodiment. As recognized herein, thetrackers 60 may be positioned on or within any suitable surface of theanimated FIG. 12 that enables the trackers 60 to be concealed from guestview. The trackers 60 enable a tracking camera 64 of the media controlsystem 20 to sense or resolve a position and an orientation of theanimated FIG. 12 within the amusement attraction 10, such as via opticalperformance capture or optical motion capture techniques. The trackingcamera 64 may also be inconspicuous or concealed from view by the guests34 in any suitable manner, such as by being positioned on the stageceiling 22 or hidden within the scenery objects 26. Thus, as will beunderstood, the projector 16 may provide the images 14 onto the animatedFIG. 12 in synchronization with an actual, current position andorientation (e.g., pose) of the animated FIG. 12 , without relying onposition, velocity, and/or acceleration information from actuators ofthe animated FIG. 12 , to provide improved show quality with reducedlatency and enhanced realism. In other embodiments, the media controlsystem 20 may verify the positioning and operation of the projector 16based on actuator-derived information from the motion control system 50.

It should be understood that the reactive media system 8 may include anysuitable number of projectors 16, trackers 60, and tracking cameras 64.For example, more than one animated FIG. 12 may be included within asingle amusement attraction 10. As such, when multiple animated FIG. 12are provided that are viewable to the guests 34 from a single side ofthe show set, the reactive media system 8 may include at least oneprojector 16 for each animated FIG. 12 . However, it is presentlyrecognized that the particular infrastructure of the reactive mediasystem 8 enables any number of animated FIG. 12 that are moveable withinan optical range of at least one tracking camera 64 and moveable withina projection cone of at least one projector 16 to receive the images 14,without substantial redesign or reconfiguration of the reactive mediasystem 8. In other words, as additional animated FIG. 12 are providedwith trackers 60 and placed within the amusement attraction 10, thereactive media system 8 may readily detect and accommodate theadditional animated FIGS. 12 , in accordance with the presentdisclosure. In other embodiments, multiple projectors 16 may be providedto deliver content to multiple sides of a single animated FIG. 12 , suchas an animated FIG. 12 that may be approached by guests 34 from multipleportions of the show set. Additionally, certain embodiments of theanimated FIG. 12 may include at least two trackers 60 to enable thetracking camera 64 to resolve the relative positioning of the at leasttwo trackers 60 for efficient tracking of the animated FIG. 12 , thoughit should be understood that changes in position of a single tracker 60may also enable resolution of the position of the animated FIG. 12 ,with a less complex system.

FIG. 2 illustrates an embodiment of the reactive media system 8 of theamusement attraction 10 including the media control system 20 and themotion control system 50, as well as an example of an interactive datasource 70 that includes guest sensors 72. In the present embodiment, theguest sensors 72 collect guest input from any guests 34 within the guestarea 32. As recognized herein, the guest input is one form ofinteractive data that may be utilized by the animated FIG. 12 toadaptively respond to a current state of the animated FIG. 12 oramusement attraction 10. In the present embodiment, the guest sensors 72may be any suitable devices that collect data from or regarding theguests 34 as the interactive data. The guest input collected by theguest sensors 72 may include active input and/or passive input, incertain embodiments. For example, the animated FIG. 12 may respond tomacroscopic gestures of the guests 34 by implementing gesturalrecognition. As passive input, the animated FIG. 12 may respond todetermined positions, orientations, features, and/or heights of theguests 34. Additionally, in certain embodiments, the guest sensors 72include physical input devices, such as buttons, levers, knobs, and soforth. Moreover, it should be understood that the guest sensors 72 maycollect any suitable visual data, auditory data, haptic input, data frominteractive guest devices (e.g., smart phones, tablets), identificationinformation from guest arm bands, input from interactive guest toys, andso forth.

As mentioned, based on the interactive data, the motion control system50 may generate an interactive and/or reactive response for the animatedFIG. 12 to perform, and then instruct actuators of the animated FIG. 12to perform the interactive and/or reactive response. As a particular,non-limiting example, the motion control system 50 may determine thatthe interactive data includes guest input indicative of one guest 34physically and/or verbally greeting the animated FIG. 12 from an edgeportion of the guest area 32. Then, the motion control system 50 maydynamically instruct the animated FIG. 12 to perform an interactive,physical response to the greeting of the guest 34. For example, themotion control system 50 may control the animated FIG. 12 to rotate toface the guest 34, while waving an arm of the animated FIG. 12 . Asanother particular example of the interactive response, the motioncontrol system 50 may control the animated FIG. 12 to respond to theguest input by moving closer to a determined position of the guest 34(e.g., via the actuatable motion device 66 disposed underneath theanimated FIG. 12 ) and tilting the head portion 44 of the animated FIG.12 to provide the appearance of focus on or eye contact with the guest34 having a particular height, and so forth.

With the above understanding of the general operation of the reactivemedia system 8 in mind, further discussion is provided herein regardingcertain embodiments of particular components of the reactive mediasystem 8. For example, FIG. 3 is a block diagram of the reactive mediasystem 8 illustrating the media control system 20 that may operate toexternally deliver content or images to the animated FIG. 12 , withoutcommunicatively coupling to the motion control system 50. In otherwords, the media control system 20 does not directly transmit to orreceive communication signals from the motion control system 50.However, as discussed below, the interactive data sources 70 may becommunicatively coupled upstream of both the media control system 20 andthe motion control system 50 to enable coordination of the media controlsystem 20 and the motion control system 50, without intercommunicationbetween the control systems 20, 50. Moreover, in certain embodiments, anetwork device 90, such as a switch or a hub, may be communicativelycoupled directly downstream of the interactive data sources 70 tofacilitate efficient communications between the interactive data sources70 and the control systems 20, 50. However, it should be understood thatthe network device 90 may be omitted, that multiple network devices 90may be implemented, or that any other suitable data management devicemay be utilized to facilitate delivery of data from the interactive datasources 70 to the control systems 20, 50. In the illustrated embodiment,the animated FIG. 12 includes a figure processor 100 and a figure memory104, which may collectively form all or a portion of a figure controller102 of the motion control system 50. The animated FIG. 12 also includesthe trackers 60 disposed on the body 42 of the animated FIG. 12 toenable the tracking cameras 64 of the media control system 20 to sensethe position and orientation, or pose, of the animated FIG. 12 . Thetrackers 60 may be active devices, which may each emit an individualizedsignal to the tracking cameras 64. For example, the trackers 60 may emitinfrared light, electromagnetic energy, or any other suitable signalthat is undetectable by the guests 34 while being distinguishable by thetracking cameras 64. Alternatively, the trackers 60 may be passivedevices (e.g., reflectors, pigmented portions) that do not emit a signaland that enable the tracking cameras 64 to precisely distinguish thepassive devices from other portions of the animated FIG. 12 and/oramusement attraction 10.

Moreover, the animated FIG. 12 is fitted with any suitable actuators 106that enable the animated FIG. 12 to move (e.g., ambulate, translate,rotate, pivot, lip synchronize) in a realistic and life-emulatingmanner. The actuators 106 may include servo motors, hydraulic cylinders,linear actuators, and so forth that are each positioned and coupled todevelop relative motion between respective portions of the animated FIG.12 . For example, respective sets of actuators 106 may be positioned tomove an arm of the animated FIG. 12 , move an articulating jaw of theanimated FIG. 12 , manipulate a figure portion (e.g., the head portion44, arm portion, torso portion, leg portion) of the animated FIG. 12 ,and so forth. As mentioned above, the interactive data sources 70 mayinclude any suitable data source that provides a variable set of dataover time as interactive data 109. As such, in certain embodiments ofthe interactive data sources 70 that include input sensors or guestsensors 72 (e.g., depth cameras, input devices, motion sensors), theguest sensors 72 may sense guest interactions with the animated FIG. 12and relay interactive data indicative of the guest interactions to thefigure controller 102. In any case, based on the interactive data 109from the interactive data sources 70, the figure controller 102 mayinstruct the actuators 106 to dynamically manipulate the animated FIG.12 to immediately respond and adapt to any suitable interactive data 109that may be variable over time, as discussed in more detail below.

Communicatively coupled (e.g., via wireless or wired communicationpaths) to the figure controller 102, the interactive data sources 70 mayinclude any one or more suitable components that generate and transmitthe interactive data 109 to the figure controller 102 and/or the mediacontroller discussed below. For example, the interactive data sources 70may include a dedicated game engine or computing device that dynamicallygenerates instructions executable by the animated figure controller 102to cause the animated FIG. 12 to modify its movements within theamusement attraction 10. In some embodiments, the dedicated game enginemay be embedded within the animated figure controller 102 as a suitablemodule thereof. In certain embodiments, the interactive data 109provided by the interactive data sources 70 includes input orinstructions received from a health status monitoring system of themotion control system 50, from a global or main control system of theamusement attraction 10, from a computing device associated with atechnician of the amusement attraction 10, and so forth. As furtherexamples, the interactive data 109 may additionally or alternativelyinclude time of day data, weather data, social media data, stock marketdata, ride vehicle position data, or any suitable data stream that mayvary over time. It should be understood that the animated FIG. 12 maytherefore adaptively respond to any suitable number of interactive datasources 70. Indeed, the interactive data 109 provided by the interactivedata sources 70 includes any suitable stream(s) of input informationthat may be selectively constant and/or variable over time to enable theanimated figure controller 102 to dynamically control the operation ofthe animated FIG. 12 . As such, the motion control system 50 may performa figure feedback loop that modifies or verifies operations of theanimated FIG. 12 based on the interactive data 109.

Additionally, in some embodiments, the interactive data sources 70 mayinclude the guest sensors 72, which include any combination ofcomponents that are suitable for resolving the guest interactions.Indeed, it is presently recognized that the guest interactions may besensed by any suitable optical, mechanical, electro-mechanical,electro-magnetic, auditory, pressure, and/or temperature transducers orsensors of any kind. As particular, non-limiting examples, the guestsensors 72 may include any suitable number or combination of computervision sensors (e.g., cameras), depth cameras, Light Detection andRanging (LIDAR) devices, motion sensors, audio recording and/orprocessing devices, touch capacitance sensors, light sensors, pressureor floor mat sensors, radio-frequency (RF) sensors that receive auniquely identifying RF signal from a user wearable device having aradio-frequency identification (RFID) tag, and so forth. That is, theguest sensors 72 may include any suitable components or transducers thatgenerate a signal based on monitoring the guests 34 in the guest area32. Although illustrated as including the guest sensors 72 external tothe body 42 of the animated FIG. 12 , it should be understood that otherembodiments of the motion control system 50 may include all or a portionof the guest sensors 72 disposed within the body 42 of the animated FIG.12 . In other embodiments, the interactive data sources 70 of the motioncontrol system 50 may exclude the guest sensors 72 and enable theanimated FIG. 12 to adaptively respond to any other suitable source(s)of interactive data 109.

As illustrated, the present embodiment of the media control system 20includes the projector 16, four tracking cameras 64, a camera networkdevice 110, and a media controller 112. The media controller 112 iscommunicatively coupled to the interactive data sources 70 (e.g., viathe network device 90), thereby enabling the media controller 112 todynamically react to the physical environment of the amusementattraction 10, such as by determining whether guest input or anotherchange-causing source of interactive data 109 is received. Additionally,the media control system 20 may be communicatively isolated from themotion control system 50, as shown in the present embodiment. That is,the motion control system 50 is independent from the media controlsystem 20, while the media control system 20 follows or depends on theanimated FIG. 12 . Thus, the media control system 20 providesoperational freedom to the animated FIG. 12 for adaptively responding tothe interactive data 109 in substantially real-time (e.g., withinmicroseconds or milliseconds of an interaction), while the media controlsystem 20 monitors or traces movements of the animated FIG. 12 toproject immersive textures or images thereon also in substantiallyreal-time. As such, while the motion control system 50 performs thefigure feedback loop, the media control system 20 simultaneouslyperforms a media feedback loop that modifies or verifies the images thatare projected onto the animated FIG. 12 . To gather informationregarding a current position and orientation of the animated FIG. 12 ,the media control system 20 leverages the tracking cameras 64, which aresuitably positioned within the amusement attraction 10 to identify orpinpoint the trackers 60 of the animated FIG. 12 via optical motioncapture techniques. A type or configuration of the tracking cameras 64may be individually selected to correspond to a type of the trackers 60.As a brief summary, when using active devices as the trackers 60, thetracking cameras 64 may be designed to receive signals from the activedevices to sense the position of the animated FIG. 12 . When usingpassive devices as the trackers 60, the tracking cameras 64 may bedesigned to discern the passive devices on the external surface 40 ofthe animated FIG. 12 . The positioning of these trackers 60, inconjunction with geometric or skeletal models of the animated FIG. 12 ,facilitates coordination of projection onto the animated FIG. 12 indifferent orientations.

The tracking cameras 64 of the illustrated embodiment arecommunicatively coupled to the camera network device 110, which relayssignals indicative of the current three-dimensional position (e.g.,including x, y, and z coordinates), orientation, and scale of theanimated FIG. 12 or portions thereof (e.g., a pose of the animated FIG.12 ) to the media controller 112. The camera network device 110 istherefore a network switch or sensor hub that consolidates multiplestreams of information from the tracking cameras 64 for efficientprocessing by the media controller 112. The media controller 112includes a media processor 114 and a media memory 116, which operatetogether to determine, generate, and/or adjust dynamic textures orimages to be overlaid onto the animated FIG. 12 in its current positionand orientation. Then, the media controller 112 may instruct theprojector 16 to project dynamic images onto the animated FIG. 12 . Theimages may be wholly rendered on demand based on a current pose (e.g.,position, orientation, and scale) of the animated FIG. 12 . In lesscomplex configurations, the images may be generated by adapting aprerecorded video stream to the current pose of the animated FIG. 12 .The media controller 112 may be any suitable media generator or gameengine with significant processing power and reduced latency, inaccordance with the present disclosure. It should be understood that themedia controller 112 is therefore capable of generating the images to beprojected onto the animated FIG. 12 in substantially real-time, based onthe sensor data received from the tracking cameras 64. Indeed, the mediacontroller 112 may maintain a skeletal model or algorithm thatrepresents the animated FIG. 12 and its actuatable portions (e.g., jaw,limbs, joints). Based on the sensor data, the media controller 112 mayupdate the skeletal model to represent an actual, current position andorientation of the animated FIG. 12 , and then generate the images to beprojected onto the animated FIG. 12 having the current position andorientation.

The projector 16 may include a projector processor 120 and a projectormemory 122 to facilitate the presentation of the images or dynamictextures onto the animated FIG. 12 . The projector processor 120generally receives data indicative of the images from the mediacontroller 112, and then instructs a light source within the projector16 to output the images through a lens. The projector 16 may be moveableor actuatable to follow and align with the animated FIG. 12 , such asbased on commands received from the media controller 112. Alternatively,the projector 16 may be stationary. In any case, the media controller112 may determine a current silhouette or a shape of a target figureportion of the animated FIG. 12 that is to receive projected imagesbased on the updated skeletal model, and then instruct the projector 16to provide the images onto the silhouette. It should be understood thatthe projector 16 may therefore block off or mask out portions of theanimated FIG. 12 and/or amusement attraction 10 that are not designed toreceive the images 14, such as a wig of the animated FIG. 12 , thescenery objects 26 behind the animated FIG. 12 relative to the projector16, and so forth.

The processors 100, 114, 120 are each any suitable processor that canexecute instructions for carrying out the presently disclosedtechniques, such as a general-purpose processor, system-on-chip (SoC)device, an application-specific integrated circuit (ASIC), a processorof a programmable logic controller (PLC), a processor of an industrialPC (IPC), or some other similar processor configuration. Theseinstructions are encoded in programs or code stored in a tangible,non-transitory, computer-readable medium, such as the memories 104, 116,122 and/or other storage circuitry or device. As such, the figureprocessor 100 is coupled to the figure memory 104, the media processor114 is coupled to the media memory 116, and the projector processor 120is coupled to the projector memory 122.

The present embodiment of the reactive media system 8 also includes ashow control system 130 that coordinates additional output devices ofthe amusement attraction 10 based on the interactive data sources 70.For example, a show controller 132 of the show control system 130 iscommunicatively coupled between the network device 90 and one ormultiple lighting output devices 134, audio output devices 136, and/orvenue-specific special effect output devices 138 (e.g., fog machines,vibration generators, actuatable portions of the scenery objects 26).The lighting output devices 134 may include the stage lighting devices30 (e.g., including the lighting instruments), as well as any otherlight-generating components of the amusement attraction 10.Additionally, the audio output devices 136 may include any suitablespeakers or noise-generating devices that are designed to output soundsbased on instructions from the show controller 132. As such, based onthe interactive data 109 received from the interactive data sources 70,the show controller 132 may coordinate a presentation of the outputdevices 134, 136, 138 to correspond with the interactive and/or reactiveresponse of the animated FIG. 12 and the media control system 20.

As one particular example of the present techniques, FIG. 4 is across-sectional side view of the head portion 44 of the animated FIG. 12having the trackers 60 on the back surface 62 of the body 42, relativeto the projector 16. The trackers 60 are active trackers (e.g., infraredlight emitting diodes) in the present embodiment, and are thus connectedin a circuit 150 that is coupled to or integrated with a power supply152 of the animated FIG. 12 . The power supply 152 may be a main powersupply of the animated FIG. 12 , or alternatively, a separate powersupply that is dedicated to powering the trackers 60. Generally, thetrackers 60 utilize electrical energy from the power supply 152 to emitindividualized signals for resolution by the tracking cameras 64. Forexample, a first tracker 160 of the trackers 60 may emit a first signalhaving a first, unique identifying signal (e.g., frequency, signature,signal characteristic). A second tracker 162 and a third tracker 164 ofthe trackers 60 may also emit respective, unique identifying signals. Bydistributing the trackers 60 around a curved portion 166 of the headportion 44 of the body 42, the trackers 60 may enhance the traceabilityof the animated FIG. 12 , such as by enabling the head portion 44 to beresolved by the tracking cameras 64 from multiple sides (e.g., top side,back side) of the animated FIG. 12 .

Moreover, the trackers 60 may extend from the curved portion 166 of theanimated FIG. 12 by a protrusion distance 170. Notably, because thesignals emitted by the trackers 60 may pass through certain materials,the trackers 60 having the protrusion distance 170 may be hidden by acostume (e.g., wig, hat, fur) of the animated FIG. 12 to conceal thetrackers 60 and further contribute to the realism of the animated FIG.12 . However, in the illustrated embodiment, the animated FIG. 12includes a wig 171 having gaps 172 (e.g., apertures, openings, roundholes) formed over the trackers 60 that further facilitate transmittalof the signals from the trackers 60 to the tracking cameras 64 discussedabove. That is, the gaps 172 may be relatively small openings formedthrough the wig 171 that do not interfere with the signals, whileenabling remaining portions of the wig 171 to efficiently conceal thetrackers 60. Additionally, although illustrated with three trackers 60,it should be understood that any suitable number of trackers 60 may beincluded or concealed within the animated FIG. 12 , such as one, two,five, ten, or more trackers 60. Alternatively, the trackers 60 may beflush with or even recessed within an outer surface of the animated FIG.12 , such as discussed below with reference to FIG. 5 .

The animated FIG. 12 also includes a set of the actuators 106 to movethe head portion 44 of the animated FIG. 12 , in the present embodiment.For example, the actuators 106 may be operatively coupled to amulti-directional support 173, illustrated as a universal joint 174(e.g., U-joint, universal coupling device) having a pivot bar assembly175, to resemble or mirror motions of a human neck. In particular, basedon selective force 176 provided by the actuators 106, themulti-directional support 173 may enable the head portion 44 to movealong a head nod axis 178, a head turn axis 180, and/or a head tilt axis182, thereby providing multiple degrees of freedom of motion to theanimated FIG. 12 . It should be understood that any suitable supportingelements or support structures having any suitable ranges and directionsof movement may be included within the animated FIG. 12 , to be actuatedby any suitable actuators 106 that are either internal or external tothe animated FIG. 12 .

Moreover, the animated FIG. 12 of the present embodiment includes anarticulating jaw 184 (e.g., moveable jaw) that may move along a jawmovement axis 186, such as based on movement by a jaw actuator 188 ofthe actuators 106. As such, based on instruction from the figurecontroller 102, the jaw actuator 188 may move the articulating jaw 184along the jaw movement axis 186 (e.g., via adjusting a connected link190 coupled between the articulating jaw 184 and a pivoting crank 192 onthe jaw actuator 188) to enable the animated FIG. 12 to appear to bespeaking (e.g., lip synchronizing with audio of the audio output devices136), presenting varying facial expressions, and so forth. The animatedFIG. 12 may additionally or alternatively include an articulatingforehead, brow, ears, and/or any other moveable features that contributeto the realism of a particular person or character. Moreover, it shouldbe understood that the articulating jaw 184 and/or any otherarticulating components of the animated FIG. 12 may be manipulated basedon the selective force 176 applied by any suitable single or multipleactuators 106.

FIG. 5 is a cross-sectional side view of another embodiment of the headportion 44 of the animated FIG. 12 , in which the trackers 60 aremounted on a front surface 200 of the head portion 44. The trackers 60may be passive devices that are distinguishable by the tracking cameras64. In some embodiments, the passive devices are shaped as roundedcylinders or light emitting diodes, though it should be understood thatthe passive devices may have any other suitable shape, includingspherical shapes, rectangular prism shapes, and so forth. Asillustrated, a first tracker 202 is positioned on a forehead portion 204of the animated FIG. 12 , a second tracker 206 is positioned on a noseportion 208 of the animated FIG. 12 , and a third tracker 210 ispositioned on a chin portion 212 of the animated FIG. 12 . By includingthe third tracker 210 on the chin portion 212, the animated FIG. 12enables the media control system 20 to efficiently analyze the movementof the articulating jaw 184 relative to the nose portion 208 and/orforehead portion 204. For example, the media control system 20 maymonitor a relative distance between the second tracker 206 and the thirdtracker 210 and determine a current position of the articulating jaw 184relative to the nose portion 208 therefrom. Additionally, the animatedFIG. 12 is illustrated with the wig 171, though it should be understoodthat any suitable costume elements may be coupled to the animated FIG.12 . As discussed above, when the wig 171 or other costume elements aredesigned to cover the first tracker 202 and/or other trackers 60, thecostume elements may be formed with the gap 172 that enables moreefficient resolution of the trackers 60 through the costume elements.

The animated FIG. 12 may also include a translucent layer 220 disposedover the body of the animated FIG. 12 , thus providing a desiredappearance (e.g., skin) to the animated FIG. 12 , while enabling thetracking cameras to resolve the positon of the trackers 60 through thetranslucent layer 220. The translucent layer 220 may be made of anysuitable material that enables resolution of the trackers 60 through thetranslucent layer 220, such as a material including fabric, plastic,silicone, rubber, and so forth. As such, the trackers 60 may be disposedunderneath the translucent layer 220 or flush (e.g., level) with thetranslucent layer 220, in some embodiments, thereby enabling thetrackers 60 to be concealed from guest view. Although discussed ashaving active devices as the trackers 60 in FIG. 4 and passive devicesas the trackers 60 in FIG. 5 , it should be understood that activedevices and/or passive devices may be mounted on any suitable portion ofthe animated FIG. 12 .

As mentioned, based on the determined, actual position and orientationof the animated FIG. 12 , the media control system 20 operates theprojector 16 to deliver one or more images 14 or projected content ontothe external surface 40 of the animated FIG. 12 . As a particularexample, FIG. 6 is a front perspective view of the images 14 providedonto the head portion 44 of the body 42 of the animated FIG. 12 . Inparticular, the illustrated embodiment of the images 14 includestextures that resemble a face of a particular character. For example,eyebrows, eyes, a nose, lips, and/or wrinkles may be projected on to thehead portion 44. Further, because the animated FIG. 12 is outfitted witha costume element 250, which is depicted as a hat in FIG. 6 , the mediacontroller 112 and/or the projector 16 may identify an outline 252 ofthe external surface 40 of the animated FIG. 12 formed by the costumeelement 250 (e.g., via projection masking). In other embodiments, thecostume element 250 may additionally or alternatively include a wig,jewelry, a scarf, and so forth. Then, the projector 16 directs theimages 14 to a target portion or figure portion of the external surface40 of the animated FIG. 12 . As mentioned above and discussed in moredetail below, the media control system 20 may monitor movement of theanimated FIG. 12 , such as the articulating jaw 184, and projectrealistic images onto the head portion 44 of the animated FIG. 12 (orface portion thereof) to correspond to the particular, actual shape ofthe head portion 44 at any given time.

As another example, FIG. 7 is a front perspective view of anotherembodiment of the images 14 that the projector 16 of the media controlsystem 20 may provide onto the external surface 40 of the animated FIG.12 . As illustrated, the images 14 provide the animated FIG. 12 with acharacter, non-human, or fanciful appearance, such as the appearance ofan owl. The external surface 40 of the head portion 44 may be texturedto complement the images 14, in certain embodiments. It should also beunderstood that, in some embodiments, the images 14 may also includesupernatural, fanciful, or non-human images and/or effects, such asflames, smoke, shapeshifting, color morphing, and so forth.

With the above features of the reactive media system 8 in mind, furtherdiscussion is provided herein regarding operation of the components ofthe reactive media system 8 to entertain the guests 34 via the animatedFIG. 12 having the images 14 fitted thereon in real-time. For example,FIG. 8 is a flow diagram illustrating an embodiment of a process 300 bywhich the motion control system 50 may control the animated FIG. 12 torespond to interactive data 109 from the interactive data sources 70.The steps illustrated in the process 300 are meant to facilitatediscussion and are not intended to limit the scope of this disclosure,because additional steps may be performed, certain steps may be omitted,and the illustrated steps may be performed in an alternative order or inparallel, where appropriate. The process 300 may be representative ofinitiated code or instructions stored in a non-transitorycomputer-readable medium (e.g., the figure memory 104) and executed, forexample, by the figure processor 100 of the figure controller 102 of themotion control system 50. The figure processor 100 may becommunicatively coupled to other components of the reactive media system8 via a network, such as a wired or wireless network, to receive andsend the instructions and signals described below.

In the presently illustrated embodiment, the figure controller 102performing the process 300 starts (block 302) a show or display byreceiving (block 304) one or more suitable streams of interactive data109 from the interactive data sources 70, such as instructions from adedicated game engine, a health status monitoring system of the motioncontrol system 50, a global or main control system of the amusementattraction 10, a computing device associated with a technician of theamusement attraction 10, and/or sensor signals from the guest sensors 72indicative of an action or position of at least one guest 34, and soforth. Indeed, as mentioned above, the interactive data 109 may alsoinclude time of day data, weather data, social media data, stock marketdata, ride vehicle position data, and/or any suitable data stream thatmay vary over time. For example, the figure controller 102 may receivetime of day data from the interactive data sources 70 that indicates aparticular character performance should be presented. As anotherexample, the figure controller 102 may receive instructions from thededicated game engine indicative of an instructed adjustment to thecharacter performance. As a further example, the figure controller 102may receive sensor signals from the guest sensors 72, which may transmitthe sensor signals continuously, or alternatively, in response todetecting a particular motion or sound from the guest 34. In suchembodiments, the guest sensors 72 may scan an RFID tag worn by eachguest 34 and transmit identification information from the RFID tag tothe figure controller 102 as the sensor signals.

Moreover, the figure controller 102 may determine (block 306) one ormore actions based on the interactive data 109 received from eachinteractive data source 70. That is, the figure controller 102 mayreceive and simultaneously respond to multiple different interactivedata sources 70, which may or may not include guest input. For example,the figure controller 102 may perform suitable animated figure controlactions based on interactive data 109 received from a game engine, froma computing device associated with a technician of the amusementattraction 10, from a status monitoring system of the motion controlsystem 50, and so forth. As a particular example, in response toreceiving corresponding interactive data 109 from a computing deviceassociated with a technician, the figure controller 102 may adjust theanimated FIG. 12 from providing a detailed show performance (e.g.,including more than a threshold number of movements) to providing asimplified show experience (e.g., including less than the thresholdnumber of movements). As another example, in response to receivingweather data indicative of an oncoming weather change, the figurecontroller 102 may adjust the character or show performance to interactwith the changed weather (e.g., acknowledge the presence of sun, rain,snow).

In embodiments that receive guest input, the actions determined by thefigure controller 102 may include determining that the guest hasperformed a particular action (e.g., corresponding to active input)and/or has a particular set of qualities (e.g., corresponding to passiveinput). As examples of particular actions detectable by the guestsensors 72 as guest input, the figure controller 102 may determine thatthe guest 34 has moved within a threshold distance from the animatedFIG. 12 , waved, spoken, pressed a button, picked up a particularobject, aimed a device (e.g., flashlight, laser pointer, imitationweapon) at a target portion of the animated FIG. 12 , and so forth. Asexamples of particular sets of qualities sensed by the guest sensors 72as guest input, the figure controller 102 may determine a height of eachguest 34, determine an average height of a group of guests 34, retrieveprofile information for each guest from a database based on theidentification information of the RFID tag, identify that a particularguest 34 is wearing clothing having a target color, and so forth.Indeed, it should be understood that the figure controller 102 maydetermine any suitable information regarding the guests 34 and theirparticular actions in the guest area 32 to affect the interactions ofthe animated FIG. 12 with the guests 34, in accordance with the presenttechniques.

Further, the figure controller 102 may generate (block 310) aninteractive response to be performed by the animated FIG. 12 as areaction to the actions of the amusement attraction 10. That is, thefigure controller 102 may calculate the interactive response to theinteractive data 109 in substantially real-time, thereby reacting to thecurrent state, actions, and positions of the amusement attraction 10and/or the guests 34 therein for improved guest immersion in theamusement attraction 10. As one example, the figure controller 102 mayreceive input indicating that one guest 34 spoke an assigned name of theanimated FIG. 12 from a particular position within the guest area 32.Then, the figure controller 102 may determine that the interactiveresponse is for the animated FIG. 12 to wave a hand at the guest 34 inthe particular position, move the articulating jaw 184 to correspond tothe animated character speaking “Hi to you too,” while the show controlsystem 130 causes the audio output devices 136 of the amusementattraction 10 to output an utterance of “Hi to you too.”

With the interactive response determined, the figure controller 102following the process 300 instructs (block 312) the actuators 106 of theanimated FIG. 12 to perform the interactive response. As discussed belowwith reference to FIG. 9 , the media control system 20 simultaneouslyresponds to the current pose of the animated FIG. 12 to dynamicallycontour map images 14 thereon. It should be understood that the showcontroller 132 may also simultaneously control any other output devicesof the amusement attraction 10 based on the interactive data sources 70to supplement the interactive response of the animated FIG. 12 ,including the stage lighting devices 30 (e.g., lighting instruments) orother lighting output devices 134, the audio output devices 136, thevenue-specific special effect output devices 138 (e.g., smoke machines,air generating devices), and so forth. As an example, in response to oneguest 34 pointing a flashlight at the animated FIG. 12 , the showcontroller 132 may instruct the stage lighting devices 30 to dim, whilethe figure controller 102 instructs the actuators 106 to cause theanimated FIG. 12 to raise both arms of the animated FIG. 12 . As anotherexample, in response to the guest 34 entering a particular region of theguest area 32 (e.g., as sensed by a light curtain, pressure mat, ordepth camera of the guest sensors 72), the figure controller 102 mayinstruct the actuators 106 to move the animated FIG. 12 closer to theparticular region.

After an interactive response is performed, the figure controller 102may return to block 304 to continue receiving interactive data 109, suchthat the motion control system 50 continuously operates the animatedFIG. 12 during operational hours of the amusement attraction 10.However, it should be understood that other embodiments may implement ashow cycle that adjusts or stops in response to particular,predetermined conditions being met, such as a threshold amount of timehaving passed, a threshold number of interactive responses beingperformed, each guest 34 leaving the guest area 32, a new or subsequentride vehicle entering the guest area 32, and so forth. In such cases,the motion control system 50 thus conserves operation and wear of theanimated FIG. 12 until a next show cycle begins.

FIG. 9 is a flow diagram of an embodiment of a process 350 for the mediacontrol system 20 to dynamically map images 14 onto the animated FIG. 12. As mentioned with respect to the process 300 of FIG. 8 , steps of theprocess 350 are not limiting. The process 350 may be representative ofinitiated code or instructions stored in a non-transitorycomputer-readable medium (e.g., the media memory 116) and executed, forexample, by the media processor 114 of the media controller 112 of themedia control system 20. It should be understood that the mediaprocessor 114 may be communicatively coupled to other components of thereactive media system 8 via a network, such as a wired or wirelessnetwork, to receive and send the instructions and signals describedbelow.

To start (block 352) the process 350, the media controller 112 mayreceive (block 354) signals (e.g., sensor feedback) from the one ormultiple tracking cameras 64 that are indicative of a current pose(e.g., current position, current orientation, and/or current scale) ofthe animated FIG. 12 . The media controller 112 may receive the signalsfrom the tracking cameras 64 though the camera network device 110, whichfacilitates efficient computations within the media controller 112. Asnoted above, the animated FIG. 12 includes the trackers 60 concealedthereon or therein to enable the tracking cameras 64 to identify thecurrent pose of the animated FIG. 12 , without receiving or relying onposition, velocity, and/or acceleration information from the actuators106 of the animated FIG. 12 . In combination with an efficient scanningrate of the tracking cameras 64 and a frame rate of the projector 16,such a configuration enables the animated FIG. 12 to react to theinteractive data 109 with reduced latency or lag, thereby more closelyresembling a live character or person.

The media controller 112 may alternatively be coupled to the actuators106 or the figure controller 102 and receive position, velocity, and/oracceleration information, which the media controller 112 may leverage toverify the detected pose of the animated FIG. 12 . Indeed, the mediacontroller 112 may predict future actions of the animated FIG. 12 basedon the received position information, thereby according a lead-time tothe media controller 112 for generating the projectable images. Themedia controller 112 operating predictively may generate multiple setsof images 14, each corresponding to a particular future interactiveresponse of the animated FIG. 12 . As such, the media controller 112 maytherefore select one of the sets of projected content that waspreviously generated, enabling the media control system 20 toinstantaneously provide the appropriate images (e.g., textures) when agiven course of action of the animated FIG. 12 is realized.

The media controller 112, performing the process 350, updates (block356) a skeletal model 360 of the animated figure based on the signalsfrom the tracking cameras 64. The skeletal model 360 may include anysuitable data structure and/or statistical model maintained in the mediacontroller 112 to represent the moveable or actuatable portions of theanimated figure, as well as the current position and orientation of theactuatable portions. As such, the media controller 112 may continuouslyupdate the skeletal model 360 to represent the actual, current pose(e.g., position, orientation, and scale) of the animated FIG. 12 .

In certain situations in which a particular actuatable joint or portionof the animated FIG. 12 is non-operational, the media controller 112updates the skeletal model 360 to indicate a non-operational status ofthe particular actuatable portion, while reacting to the currentposition of the trackers 60 to enable the images 14 to be adaptively fitto the partially non-operational animated FIG. 12 . That is, in suchsituations, the media controller 112 performing the process 350 maygenerate suitable images that correspond to the actual pose of theanimated FIG. 12 , thereby ensuring an appropriate set of images aregenerated for the non-operational portions of the animated FIG. 12 . Incontrast, certain projection mapping systems following pre-programmedscenes (e.g., via canned media) may project images onto the expectedposition of a given moveable portion of a traditional animated figure,thereby detracting from guest experience when the given moveable portionbecomes non-operational, as the images do not match the traditionalanimated figure.

The media controller 112 therefore generates (block 362) data indicativeof the images 14 to be projected onto the animated FIG. 12 having thecurrent pose based on the skeletal model 360. In contrast topredetermined or canned images, the images 14 are generated in-situ orin real time to particularly correspond to a current state or pose ofthe animated FIG. 12 . Additionally, the data indicative of the images14 and/or the current pose of the animated FIG. 12 may be stored in themedia memory 116 for a predetermined time period.

The media controller 112 additionally instructs (block 364) theprojector 16 to provide (e.g., contour map) the images 14 onto theanimated FIG. 12 having the current pose. As recognized herein, themedia control system 20 implements contour mapping or contour-focusmapping with the skeletal model 360 to direct the selectively designedimages 14 onto targeted figure portions of the animated FIG. 12 in alifelike manner. For example, the media controller 112 may generate, andinstruct the projector 16 to output, the images 14 that are tuned to theparticular position and orientation of the animated FIG. 12 , therebygenerating a contour mapped set of textures that are precisely focusedto the particular spatial positioning of the animated FIG. 12 . Themedia controller 112 may inherently provide the instructions of block364 by transmitting the data indicative of the images 14 to theprojector 16 without a separate instruction signal, thereby furtherlimiting latency of the media control system 20. As such, the componentsof the media control system 20 cooperate to adaptively analyze theanimated FIG. 12 and dynamically fit the images 14 onto an instantaneouspose of the animated FIG. 12 , which may be reacting to the interactivedata sources 70 and/or interacting with the guests 34 at any given time.The media controller 112 may therefore return to block 354 to continuereceiving sensor signals and continue performing the process 350.

Moreover, the media control system 20 may monitor performance and orhealth of the animated FIG. 12 . For example, it is presently recognizedthat the media control system 20 may perform health monitoring of theanimated FIG. 12 based on the determined performance of the animatedFIG. 12 over time. That is, if a particular set of images was projectedonto the animated FIG. 12 at a particular time point during a show cycle(e.g., a baseline performance assessment), and after a period of time,the media control system 20 adjusted (e.g., displaced) the set of imagesfor the particular time point in a later show cycle by more than athreshold adjustment (e.g., current performance assessment), the mediacontrol system 20 may generate an alert indicative of the differencebetween the iterations of the show cycle. For example, if the headportion 44 of the animated FIG. 12 is unintentionally modified ordegraded such that a left ear of the animated FIG. 12 is not present andis not projected onto via the projector 16, the media control system 20may alert an operator to the degradation. As another example, if aparticular portion of the animated FIG. 12 moved during a first showcycle, such as a tilt or rotation of the head portion 44, but isstationary during a second show cycle (e.g., corresponding to a modifiedskeletal model 360), the media control system 20 may output an alertindicative of a non-operational portion of the animated FIG. 12 . Inthese situations, the media controller 112 may output an alertindicative of the degraded status and/or sensed, uncharacteristicbehavior change. In some cases, the reactive media system 8 may bedesigned to stop operation of the media control system 20 and/or themotion control system 50 in response to the alert. In other cases, inresponse to determining that the performance of the animated FIG. 12 isonly marginally affected (e.g., has a skeletal model deviation that ismore than a first threshold and less than a second, higher threshold),the media controller 112 may provide the alert and continue cyclingthrough the process 350. Therefore, it should be understood that thepresent media control system 20 may operate as a quality assessment toolthat quantifies the performance of the motion control system 50 and theanimated FIG. 12 over time.

As such, technical effects of the disclosed reactive media systeminclude a motion control system with an animated figure that dynamicallyreacts to interactive data, such as game engine, health monitoringsystem, background performer, guest, and/or technician input, to deliveran engaging and realistic experience to amusement attraction guests. Inparticular, the motion control system may include one or multipleinteractive data sources that provide interactive data, such as guestsensors that sense active actions and/or passive qualities of the guestsas the guest input, as well as a figure controller that generates aninteractive response based on the interactive data. Therefore, thefigure controller instructs actuators within a body of the animatedfigure to perform the interactive response, such as by manipulating anarticulating jaw or other moveable portions of the body. Moreover, thereactive media system includes a media control system having trackingcameras, a media controller, and a projector. As recognized herein, theanimated figure is fitted with trackable markers that enable the mediacontroller to receive, from the tracking cameras, sensor feedbackindicative of a current position, orientation, and scale of moveableportions of the animated figure. Therefore, without relying oninformation derived from the actuators of the animated figure, the mediacontroller may dynamically generate or tailor a set of images to theparticular position, orientation, and scale of the moveable portions ofanimated figure. Then, the media controller may instruct the projectorto projection map the images onto an external surface of one or morefigure portions of the animated figure in real-time, thereby presentingan immersive and engagingly-lifelike animated figure for improved guestenjoyment with improved up-time and/or reliability.

While only certain features of the disclosure have been illustrated anddescribed herein, many modifications and changes will occur to thoseskilled in the art. It is, therefore, to be understood that the appendedclaims are intended to cover all such modifications and changes as fallwithin the true spirit of the disclosure. It should be appreciated thatany of the features illustrated or described with respect to the figuresdiscussed above may be combined in any suitable manner.

The techniques presented and claimed herein are referenced and appliedto material objects and concrete examples of a practical nature thatdemonstrably improve the present technical field and, as such, are notabstract, intangible or purely theoretical. Further, if any claimsappended to the end of this specification contain one or more elementsdesignated as “means for [perform]ing [a function] . . . ” or “step for[perform]ing [a function] . . . ”, it is intended that such elements areto be interpreted under 35 U.S.C. 112(f). However, for any claimscontaining elements designated in any other manner, it is intended thatsuch elements are not to be interpreted under 35 U.S.C. 112(f).

The invention claimed is:
 1. A reactive media system of an amusementattraction, the reactive media system comprising: a motion controlsystem, comprising: an animated figure having a body and a set ofactuators configured to adjust a figure portion of the body in responseto interactive data received from one or more interactive data sources;and a set of trackers coupled to a first surface of the figure portionof the body, wherein each tracker of the set of trackers is configuredto emit a respective sensor signal; and a media control system,comprising: a tracking camera configured to: receive the respectivesensor signals from the set of trackers; determine a position of the setof trackers relative to one another, relative to the tracking camera, orboth based on receipt of the respective sensor signals; and generatestate signals indicative of a current position and a current orientationof the figure portion based on the position of the set of trackers; amedia controller communicatively coupled to the tracking camera andconfigured to: receive the state signals indicative of the currentposition and the current orientation of the figure portion; determinethe current position and the current orientation of the figure portionbased on the state signals; and generate data indicative of images to beprojected onto at least a second surface of the figure portion havingthe current position and the current orientation, wherein the secondsurface comprises an external surface and wherein the second surface isdifferent than the first surface; and a projector communicativelycoupled to the media controller, wherein the projector is configured to:receive the data indicative of the images from the media controller andproject the images onto the second surface of the figure portion havingthe current position and the current orientation.
 2. The reactive mediasystem of claim 1, wherein the one or more interactive data sourcescomprise a guest sensor configured to generate guest sensor signalsindicative of guest input as the interactive data, wherein the motioncontrol system comprises a figure controller coupled to the guest sensorand the set of actuators, wherein the figure controller is configuredto: determine the guest input based on the guest sensor signals from theguest sensor; generate an interactive response of the animated figure tothe guest input; and instruct the set of actuators to perform theinteractive response.
 3. The reactive media system of claim 2, whereinthe guest sensor comprises at least an optical transducer, a mechanicaltransducer, an electro-mechanical transducer, an electro-magnetictransducer, an auditory transducer, a pressure transducer, or atemperature transducer.
 4. The reactive media system of claim 2,comprising a show controller communicatively coupled to the guest sensorand to at least one output device disposed within the amusementattraction, wherein the show controller is configured to control the atleast one output device to provide an output in conjunction with theinteractive response of the animated figure, and wherein the at leastone output device comprises a light output device, an audio outputdevice, or both.
 5. The reactive media system of claim 1, comprising theone or more interactive data sources, wherein the one or moreinteractive data sources are configured to generate the interactive dataas input data that is variable over time and responsive to a currentstate of the animated figure.
 6. The reactive media system of claim 1,comprising the one or more interactive data sources, which comprise aguest sensor configured to detect guest input from a guest of theamusement attraction as the interactive data, and wherein the guestinput comprises a position, a movement, or an action of the guest thatis detectable by the guest sensor.
 7. The reactive media system of claim1, wherein the media control system is configured to project the imagesonto the second surface of the figure portion without receivingposition, velocity, or acceleration information from the set ofactuators of the animated figure.
 8. The reactive media system of claim1, wherein each tracker of the set of trackers is concealed from view toa guest and disposed within a surface of the figure portion of theanimated figure, and each tracker is configured to emit the respectivesensor signal through the surface for receipt by the tracking camera. 9.The reactive media system of claim 1, wherein the figure portioncomprises an actuatable portion of a character that is coupled to asupport structure of the character.
 10. The reactive media system ofclaim 1, wherein the media control system comprises a plurality oftracking cameras that comprises the tracking camera, and wherein theplurality of tracking cameras is coupled to a camera network device thatis coupled to the media controller.
 11. The reactive media system ofclaim 1, wherein the figure portion of the animated figure comprises aface portion of the body having a moveable jaw with at least one degreeof freedom onto which the projector is configured to project at least aportion of the images, wherein a portion of the set of actuators isconfigured to actuate the moveable jaw, and wherein the motion controlsystem is configured to instruct the portion of the set of actuators toactuate the moveable jaw in response to the interactive data.
 12. Thereactive media system of claim 1, wherein the respective sensor signalemitted by each tracker of the set of trackers comprises a uniqueidentifier, and the tracking camera is configured to distinguish eachtracker of the set of trackers from one another based on the uniqueidentifier of the respective sensor signals to determine the position ofthe set of trackers relative to one another, relative to the trackingcamera, or both.
 13. The reactive media system of claim 1, wherein theanimated figure comprises a translucent layer disposed over the body,wherein the set of trackers and the first surface are disposed beneaththe translucent layer.
 14. The reactive media system of claim 1, whereinthe tracking camera is configured to generate the data indicative ofadditional images to be projected onto the first surface.
 15. A reactivemedia system of an amusement attraction, the reactive media systemcomprising: one or more interactive data sources configured to generateinteractive data that is variable over time; a motion control systemcomprising: an animated figure disposed within the amusement attraction,wherein the animated figure comprises a figure portion that comprises amoveable joint; a set of actuators disposed within the figure portionand configured to actuate the moveable joint; and a figure controllercommunicatively coupled to the set of actuators and to the one or moreinteractive data sources, wherein the figure controller is configuredto: based on the interactive data received from the one or moreinteractive data sources, determine an interactive response of theanimated figure corresponding to a current state of the animated figure,wherein the interactive response comprises actuating the moveable joint;and instruct the set of actuators to perform the interactive response; aset of trackers coupled to the figure portion of the animated figure;and a media control system comprising: a tracking camera configured to:visibly distinguish each tracker of the set of trackers to obtain avisualization of the set of trackers; determine a respective position ofeach tracker of the set of trackers based on the visualization of theset of trackers; and generate a signal indicative of a current positionand of a current orientation of the animated figure based on therespective position of each tracker of the set of trackers; and a mediacontroller communicatively coupled to the tracking camera and configuredto: receive the signal indicative of the current position and of thecurrent orientation of the animated figure from the tracking camera; andgenerate content to be projected onto a portion of the animated figurebased on the current position and the current orientation of theanimated figure and the interactive response; wherein the mediacontroller is configured to identify a non-operational portion of theanimated figure based on the determined respective position of eachtracker of the set of trackers and to adjust the generated content basedon the identified non-operational portion.
 16. The reactive media systemof claim 15, wherein the media control system comprises a projectorcommunicatively coupled to the media controller, wherein the projectoris configured to receive data indicative of the content from the mediacontroller and project the content onto the animated figure having thecurrent position and the current orientation.
 17. The reactive mediasystem of claim 16, wherein the projector is configured to move, basedon instructions from the media controller, to align with the currentposition and the current orientation of the animated figure.
 18. Thereactive media system of claim 15, wherein the motion control systemcomprises an actuatable motion device physically coupled to the animatedfigure and communicatively coupled to the figure controller, and whereinthe interactive response comprises instructing the actuatable motiondevice to move the animated figure in at least one direction relative toa stage or ground surface of the amusement attraction.
 19. The reactivemedia system of claim 18, wherein the actuatable motion device is atleast partially disposed underneath the animated figure.
 20. Thereactive media system of claim 15, wherein the set of trackers comprisesa first tracker disposed on the moveable joint of the figure portion andcomprises a second tracker disposed on a different portion of theanimated figure that is distinct from the moveable joint, wherein thetracking camera is configured to determine a first position of the firsttracker, a second position of the second tracker, a current distancebetween the first tracker and the second tracker based on the firstposition relative to the second position, and generate the signalindicative of the current position and of the current orientation of theanimated figure based on the current distance.
 21. The reactive mediasystem of claim 15, wherein the one or more interactive data sourcescomprise a guest sensor configured to sense input indicative of aninteraction of a guest of the amusement attraction with the animatedfigure as the interactive data.
 22. The reactive media system of claim15, wherein each tracker of the set of trackers is concealed within asurface of the figure portion of the animated figure, and the trackingcamera is configured to visibly distinguish each tracker of the set oftrackers through the surface to obtain the visualization of the set oftrackers.
 23. The reactive media system of claim 15, wherein the mediacontroller is configured to generate the signal indicative of thecurrent position and the current orientation of the animated figurewithout using position, velocity, and/or acceleration information fromactuators of the animated figure.
 24. The reactive media system of claim15, wherein the figure controller is configured to switch from adetailed control instruction set to a simplified control instruction setbased on the interactive data, wherein the detailed control instructionset comprises a greater number of movements of the animated figurerelative to the simplified control instruction set.